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METHOD AND APPARATUS FOR HIGH PERFORMANCE 
LOW BIT-RATE CODING OF UNVOICED SPEECH 



5 BACKGROUND 

I. Field of the Invention 

The disclosed embodiments relate to the field of speech processing. 
10 More particularly, the disclosed embodiments relate to a novel and improved 
method and apparatus for low bit-rate coding of unvoiced segments of speech. 

II. Background 

15 Transmission of voice by digital techniques has become widespread, 

particularly in long distance and digital radio telephone applications. This, in 
turn, has created interest in determining the least amount of information that 
can be sent over a channel while maintaining the perceived quality of the 
reconstructed speech. If speech is transmitted by simply sampling and 
digitizing, a data rate on the order of sixty-four kilobits per second (kbps) is 
required to achieve a speech quality of conventional analog telephone. 
However, through the use of speech analysis, followed by the appropriate 
coding, transmission, and resynthesis at the receiver, a significant reduction in 
the data rate can be achieved. 
25 Devices that employ techniques to compress speech by extracting 

parameters that relate to a model of human speech generation are called speech 
coders. A speech coder divides the incoming speech signal into blocks of time, 
or analysis frames. Speech coders typically comprise an encoder and a 
decoder, or a codec. The encoder analyzes the incoming speech frame to 
30 extract certain relevant parameters, and then quantizes the parameters into 
binary representation, i.e., to a set of bits or a binary data packet. The data 
packets are transmitted over the communication channel to a receiver and a 
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decoder. The decoder processes the data packets, unquantizes them to produce 
the parameters, and then resynthesizes the speech frames using the 
unquantized parameters. 

The function of the speech coder is to compress the digitized speech 
5 signal into a low-bit-rate signal by removing all of the natural redundancies 
inherent in speech. The digital compression is achieved by representing the 
input speech frame with a set of parameters and employing quantization to 
represent the parameters with a set of bits. If the input speech frame has a 
number of bits N, and the data packet produced by the speech coder has a 
10 number of bits N„, the compression factor achieved by the speech coder is C r = 
N ( /N e . The challenge is to retain high voice quality of the decoded speech 
while achieving the target compression factor. The performance of a speech 
coder depends on (I) how well the speech model, or the combination of the 
analysis and synthesis process described above, performs, and (2) how well the 
15 parameter quantization process is performed at the target bit rate of N, bits per 
frame. The goal of the speech model is thus to capture the essence of the speech 
signal, or the target voice quality, with a small set of parameters for each frame. 

Speech coders may be implemented as time-domain coders', which 
attempt to capture the time-domain speech waveform by employing high time- 
resolution processing to encode small segments of speech (typically 5 
millisecond (ms) subframes) at a time. For each subframe, a high-precision 
representative from a codebook space is found by means of various search 
algorithms known in the art. Alternatively, speech coders may be implemented 
as frequency-domain coders, which attempt to capture the short-term speech 
25 spectrum of the input speech frame with a set of parameters (analysis) and 
employ a corresponding synthesis process to recreate the speech waveform 
from the spectral parameters. The parameter quantizer preserves the 
parameters by representing them with stored representations of code vectors in 
accordance with known quantization techniques described in A. Gersho & R.M. 
30 Gray, Vector Quantization and Signal Compression (1992). 

A well-known time-domain speech coder is the Code Excited Linear 
Predictive (CELP) coder described in L.B. Rabiner & R.W. Schafer, Digital 
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Processing of Speech Signals 396453 (1978), which is fully incorporated herein by 
reference. In a CELP coder, the short term correlations, or redundancies, in the 
speech signal are removed by a linear prediction (LP) analysis, which finds the 
coefficients of a short-term formant filter. Applying the short-term prediction 
5 filter to the incoming speech frame generates an LP residue signal, which is 
further modeled and quantized with long-term prediction filter parameters and 
a subsequent stochastic codebook. Thus, CELP coding divides the task of 
encoding the time-domain speech waveform into the separate tasks of encoding 
of the LP short-term filter coefficients and encoding the LP residue. Time- 
10 domain coding can be performed at a fixed rate (i.e., using the same number of 
bits, N y for each frame) or at a variable rate (in which different bit rates are 
used for different types of frame contents). Variable-rate coders attempt to use 
only the amount of bits needed to encode the codec parameters to a level 
adequate to obtain a target quality. An exemplary variable rate CELP coder is 
15 described in U.S. Patent No. 5,414,796, which is assigned to the assignee of the 
presently disclosed embodiments and fully incorporated herein by reference. 

■ Time-domain coders such as the CELP coder typically rely upon a high 
number of bits, N 0 , per frame to preserve the accuracy of the time-domain 
speech waveform. Such coders typically deliver excellent voice quality 
20 provided the number of bits, Np, per frame relatively large (e.g., 8 kbps or 
above). However, at low bit rates (4 kbps and below), time-domain coders fail 
to retain high quality and robust performance due to the limited number of 
available bits. At low bit rates, the limited codebook space clips the waveform- 
matching capability of conventional time-domain coders, which are so 
25 successfully deployed in higher-rate commercial applications. 

Typically, CELP schemes employ a short term prediction (STP) filter and 
a long term prediction (LTP) filter. An Analysis by Synthesis (AbS) approach is 
employed at an encoder to find the LTP delays and gains, as well as the best 
stochastic codebook gains and indices. Current state-of-the-art CELP coders 
30 such as the Enhanced Variable Rate Coder (EVRC) can achieve good quality 
synthesized speech at a data rate of approximately 8 kilobits per second. 
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It is also known that unvoiced speech does not exhibit periodicity. The 
bandwidth consumed encoding the LTP filter in the conventional CELP 
schemes is not as efficiently utilized for unvoiced speech as for voiced speech, 
where periodicity of speech is strong and LTP filtering is meaningful 
5 Therefore, a more efficient (i.e lower bit rate) coding scheme is desirable for 
unvoiced speech. 

For coding at lower bit rates, various methods of spectral, or frequency- 
domain, coding of speech have been developed, in which the speech signal is 
analyzed as a time-varying evolution of spectra. See, e.g., R.J. McAulay & T.F. 

10 Quarieri, Sinusoidal Coding, in Speech Coding and Synthesis ch. 4 (W.B, Kleijn & 
K.K. Paliwal eds., 1995). In spectral coders, the objective is to model, or predict, 
the short-term speech spectrum of each input frame of speech with a set of 
spectral parameters, rather than to precisely mimic the time-varying speech 
waveform. The spectral parameters are then encoded and an output frame of 

15 speech is created with the decoded parameters. The resulting synthesized 
speech does not match the original input speech waveform, but offers similar 
perceived quality. Examples of frequency-domain coders that are well known 
in the art include multiband excitation coders (MBEs), sinusoidal transform 
coders (STCs), and harmonic coders (HCs). Such frequency-domain coders 

20 offer a high-quality parametric model having a compact set of parameters that 
can be accurately quantized with the low number of bits available at low bit 
rates. 

Nevertheless, low-bit-rate coding imposes the critical constraint of a 
limited coding resolution, or a limited codebook space, which limits the 

25 effectiveness of a single coding mechanism, rendering the coder unable to 
represent various types of speech segments under various background 
conditions with equal accuracy. For example, conventional low-bit-rate, 
frequency-domain coders do not transmit phase information for speech frames. 
Instead, the phase information is reconstructed by using a random, artificially 

30 generated, initial phase value and linear interpolation techniques. See, e.g., H. 
Yang et al. Quadratic Phase Interpola tion for Vnired Speech Synthesis in th P 
MBE Mod el, in 29 Electronic Letters 856-57 (May 1993). Because the phase 
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information is artificially generated, even if the amplitudes of the sinusoids are 
perfectly preserved by the quantization-unquantization process, the output 
speech produced by the frequency-domain coder will not be aligned with the 
original input speech (i.e., the major pulses will not be in sync). It has therefore 
5 proven difficult to adopt any closed-loop performance measure, such as, e.g., 
signal-to-noise ratio (SNR) or perceptual SNR, in frequency-domain coders. 

One effective technique to encode speech efficiently at low bit rate is 
multimode coding. Multimode coding techniques have been employed to 
perform low-rate speech coding in conjunction with an open-loop mode 

10 decision process. One such multimode coding technique is described in 
Amitava Das et al., Multimode and Variable-Rate Coding of Speech, in Speech 
Coding and Synthesis ch. 7 (W.B. Kleijn & K.K Paliwal eds v 1995). Conventional 
multimode coders apply different modes, or encoding-decoding algorithms, to 
different types of input speech frames. Each mode, or encoding-decoding 

15 process, is customized to represent a certain type of speech segment, such as, 
e.g., voiced speech, unvoiced speech, or background noise (nonspeech) in the 
most efficient manner. An external, open loop mode decision mechanism 
examines the input speech frame and makes a decision regarding which mode 
to apply to the frame. An external, open-loop mode decision mechanism 

20 examines the input speech frame and makes a decision regarding which mode 
to apply to the frame. The open4oop mode decision is typically performed by 
extracting a number of parameters from the input frame, evaluating the 
parameters as to certain temporal and spectral characteristics, and basing a 
mode decision upon the evaluation. The mode decision is thus made without 

25 knowing in advance the exact condition of the output speech, i.e., how close the 
output speech will be to the input speech in terms of voice quality or other 
performance measures. An exemplary open-loop mode decision for a speech 
codec is described in US. Patent No. 5,414,796, which is assigned to the 
assignee of the presently disclosed embodiments and fully incorporated herein 

30 by reference. 

Multimode coding can be fixed-rate, using the same number of bits N 0 
for each frame, or variable-rate, in which different bit rates are used for 
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different modes. The goal in variable-rate coding is to use only the amount of 
bits needed to encode the codec parameters to a level adequate to obtain the 
target quality. As a result, the same target voice quality as that of a fixed-rate, 
higher-rate coder can be obtained at a significant lower average-rate using 
5 variable-bit-rate (VBR) techniques. An exemplary variable rate speech coder is 
described in U.S. Patent No. 5,414,796, assigned to the assignee of the presently 
disclosed embodiements and previously fully incorporated herein by reference- 
There is presently a surge of research interest and strong commercial 
needs to develop a high-quality speech coder operating at medium to low bit 

10 rates (i.e., in the range of 2.4 to 4 kbps and below). The application areas 
include wireless telephony, satellite communications, Internet telephony, 
various multimedia and voice-streaming applications, voice mail, and other 
voice storage systems. The driving forces are the need for high capacity and 
the demand for robust performance under packet loss situations. Various 

15 recent speech coding standardization efforts are another direct driving force 
propelling research and development of low-rate speech coding algorithms. A 
low-rate speech coder creates more channels, or users, per allowable 
application bandwidth, and a low-rate speech coder coupled with an additional 
layer of suitable channel coding can fit the overall bit-budget of coder 

20 specifications and deliver a robust performance under channel error conditions. 

Multimode VBR speech coding is therefore an effective mechanism to 
encode speech at low bit rate. Conventional multimode schemes require the 
design of efficient encoding schemes, or modes, for various segments of speech 
(e.g., unvoiced, voiced, transition) as well as a mode for background noise, or 

25 silence. The overall performance of the speech coder depends on how well 
each mode performs, and the average rate of the coder depends on the bit rates 
of the different modes for unvoiced, voiced, and other segments of speech. In 
order to achieve the target quality at a low average rate, it is necessary to 
design efficient high-performance modes, some of which must work at low bit 

30 rates. Typically, voiced and unvoiced speech segments are captured at high bit 
rates, and background noise and silence segments are represented with modes 
working at a significantly lower rate. Thus, there is a need for a high 
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performance low-bit-rate coding technique that accurately captures a high 
percentage of unvoiced segments of speech while using a minimal number of 
bits per frame. 

5 

SUMMARY 

The disclosed embodiments are directed to a high performance low-bit- 
rate coding technique that accurately captures unvoiced segments of speech 

10 while using a minimal number of bits per frame. Accordingly, in one aspect of 
the invention, a method of decoding unvoiced segments of speech, includes 
recovering a group of quantized gains using received indices for a plurality of 
sub-frames; generating a random noise signal comprising random numbers for 
each of the plurality of sub-frames; selecting a pre-determined percentage of 

15 the highest-amplitude random numbers of the random noise signal for each of 
the plurality of sub-frames; scaling the selected highest-amplitude random 
numbers by the recovered gains for each sub-frame to produce a scaled random 
noise signal; band-pass filtering and shaping the scaled random noise signal; 
and selecting a second filter based on a received filter selection indicator and 

20 further shaping the scaled random noise signal with the selected filter. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The features, objects, and advantages of the disclosed embodiments will 
25 become more apparent from the detailed description set forth below when 
taken in conjunction with the drawings in which like reference characters 
identify correspondingly throughout and wherein: 

FIG. 1 is a block diagram of a communica tion channel terminated at each 
end by speech coders; 
30 FIG. 2A is a block diagram of an encoder that can be used in a high 

performance low bit rate speech coder; 
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FIG. 2B is a block diagram of a decoder that can be used in a high 
performance low bit rate speech coder; 

FIG, 3 illustrates a high performance low bit rate unvoiced speech 
encoder that could be used in the encoder of FIG, 2A; 
5 FIG. 4 illustrates a high performance low bit rate unvoiced speech 

decoder that could be used in the decoder of FIG, 2B; 

FIG. 5 is a flow chart illustrating encoding steps of a high performance 
low bit rate coding technique for unvoiced speech; 

FIG. 6 is a flow chart illustrating decoding steps of a high performance 
10 low bit rate coding technique for unvoiced speech; 

FIG, 7A is a graph of a frequency response of low pass filtering for use 
in band energy analysis; 

FIG. 7B is a graph of a frequency response of high pass filtering for use 
in band energy analysis; 
15 FIG. 8A is a graph of a frequency response of a band pass filter for use in 

perceptual filtering; 

FIG. 8B is a graph of a frequency response of a preliminary shaping filter 
for use in perceptual filtering; 

FIG. 8C is a graph of a frequency response of one shaping filter that may 
20 used in final perceptual filtering; and 

FIG. 8D is a graph of a frequency response of a another shaping filter 
that may be used in final perceptual filtering. 

25 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

The disclosed embodiments provide a method and apparatus for high 
30 performance low bit rate coding of unvoiced speech* Unvoiced speech signals 
are digitized and converted into frames of samples. Each frame of unvoiced 
speech is filtered by a short term prediction filter to produce short term signal 
blocks. Each frame is divided into multiple sub-frames. A gain is then 
calculated for each sub-frame. These gains are subsequently quantized and 
35 transmitted. Then, a block of random noise is generated and filtered by 
methods described in detail below. This filtered random noise is scaled by the 



PAGE 9/39 * RCVD AT 2/23/2005 6:53:52 PM [Eastern Standard Time] * SVR:USPT0-EFXRF-2/1 * DNIS:7464272 * CSID:** DURATION (mm-ss):11-36 



Feb-23-2005 03:56pm From-8588456880 + T . 960 p. 010/039 F-l 

[QCPAOOQ426] 



9 

quantized sub-frame gains to form a quantized signal that represents the short 
term signal. At a decoder, a frame of random noise is generated and filtered in 
the same manner as the random noise at the encoder. The filtered random 
noise at the decoder is then scaled by the received sub-frame gains, and passed 
5 through a short term prediction filter to form a frame of synthesized speech 
representing the original samples. 

The disclosed embodiments present a novel coding technique for a 
variety of unvoiced speech. At 2 kilobits per second, the synthesized unvoiced 
speech is perceptually equivalent to that produced by conventional CELP 

10 schemes requiring much higher data rates. A high percentage (approximately 
twenty percent) of unvoiced speech segments can be encoded in accordance 
with the disclosed embodiments. 

In FIG- 1 a first encoder 10 receives digitized speech samples s(n) and 
encodes the samples s(n) for transmission on a transmission medium 12, or 

15 communication channel 12, to a first decoder 14. The decoder 14 decodes the 
encoded speech samples and synthesizes an output speech signal s SYNTH (n)* For 
transmission in the opposite direction/ a second encoder 16 encodes digitized 
speech samples s(n), which are transmitted on a communication channel 18. A 
second decoder 20 receives and decodes the encoded speech samples, 

20 generating a synthesized output speech signal s^n).. 

The speech samples, s(n), represent speech signals that have been 
digitized and quantized in accordance with any of various methods known in 
the art including, e.g„ pulse code modulation (PCM), companded jx-law, or A- 
law. As known in the art, the speech samples, s(n), are organized into frames of 

25 input data wherein each frame comprises a predetermined number of digitized 
speech samples s(n). In an exemplary embodiment, a sampling rate of 8 kHz is 
employed, with each 20 ms frame comprising 160 samples. In the 
embodiments described below, the rate of data transmission may be varied on a 
frame-to-frame basis from 8 kbps (full rate) to 4 kbps (half rate) to 2 kbps 

30 (quarter rate) to 1 kbps (eighth rate). Alternatively, other data rates may be 
used. As used herein, the terms "full rate" or "high rate" generally refer to data 
rates that are greater than or equal to 8 kbps, and the terms "half rate" or "low 
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rate" generally refer to data rates that are less than or equal to 4 kbps. Varying 
the data transmission rate is beneficial because lower bit rates may be 
selectively employed for frames containing relatively less speech information- 
As understood by those skilled in the art other sampling rates, frame sizes, and 
5 data transmission rates may be used. 

The first encoder 10 and the second decoder 20 together comprise a first 
speech coder, or speech codec. Similarly, the second encoder 16 and the first 
decoder 14 together comprise a second speech coder. It is understood by those 
of skill in the art that speech coders may be implemented with a digital signal 

10 processor (DSP), an application-specific integrated circuit (ASIC), discrete gate 
logic, firmware, or any conventional programmable software module and a 
microprocessor. The software module could reside in RAM memory, flash 
memory, registers, or any other form of writable storage medium known in the 
art. Alternatively, any conventional processor, controller, or state machine 

15 could be substituted for the microprocessor. Exemplary ASICs designed 
specifically for speech coding are described in U.S. Patent No. 5,727,123, 
assigned to the assignee of the presently disclosed embodiments and fully 
incorporated herein by reference, and U.S. Patent No. 5,784,532, entitled 
APPLICATION SPECIFIC INTEGRATED CIRCUIT (ASIC) FOR PERFORMING 

20 RAPID SPEECH COMPRESSION IN A MOBILE TELEPHONE SYSTEM, assigned 
to the assignee of the presently disclosed embodiments, and fully incorporated 
herein by reference. 

FIG. 2A is a block diagram of an encoder, illustrated in FIG 1 (10, 16), 
that may employ the presently disclosed embodiments. A speech signal, s(n), is 

25 filtered by a short-term prediction filter 200. The speech itself, s(n), and /or the 
linear prediction residual signal r(n) at the output of the short-term prediction 
filter 200 provide input to a speech classifier 202. 

The output of speech classifier 202 provides input to a switch 203 

enabling the switch 203 to select a corresponding mode encoder (204,206) based 
30 on a classified mode of speech. One skilled in the art would understand that 
speech classifier 202 is not limited to voiced and unvoiced speech classification 
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and may also classify transition, background noise (silence), or other types of 
speech. 

Voiced speech encoder 204 encodes voiced speech by any conventional 
method such as e.g., CELP or Prototype Waveform Interpolation (PWI). 
5 Unvoiced speech encoder 205 encodes unvoiced speech at a low bit rate 

in accordance with the embodiments described below. Unvoiced speech 
encoder 206 is described with reference to detail in FIG. 3 in accordance with 
one embodiment. 

After encoding by either encoder 204 or encoder 206), multiplexer 208 
10 forms a packet bit-stream comprising data packets, speech mode, and other 
encoded parameters for transmission. 

FIG. 2B is a block diagram of a decoder, illustrated in FIG 1 (14, 20), that 
may employ the presently disclosed embodiments. 

De-multiplexer 210 receives a packet bit-stream, demultiplexes data 
15 from the bit stream, and recovers data packets, speech mode, and other 
encoded parameters. 

The output of de-multiplexer 210 provides input to a switch 211 enabling 
the switch 211 to select a corresponding mode decoder (212, 214) based on a 
classified mode of speech. One skilled in the art would understand that switch 
20 211 is not limited to voiced and unvoiced speech modes and may also 
recognize transition/ background noise (silence), or other types of speech. 

Voiced speech decoder 212 decodes voiced speech by performing the 
inverse operations of voiced encoder 204, 

In one embodiment, unvoiced speech decoder 214 decodes unvoiced 
25 speech transmitted at a low bit rate as described below in detail with reference 
to FIG. 4. 

After decoding by either decoder 212 or decoder 214, a synthesized 
linear prediction residual signal is filtered by a short-term prediction filter 216. 
The synthesized speech at the output of the short-term prediction filter 216 is 
30 passed to a post filter processor 218 to generate final output speech. 
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FIG. 3 is a detailed block diagram of the high performance low bit rate 
unvoiced speech encoder 206 illustrated in FIG 2. FIG. 3 details the apparatus 



and sequence of operations of one embodiment of the unvoiced encoder. 

Digitized speech samples, s(n), are input to Linear Predictive Coding 
5 (LPC) analyzer 302 and LPC filter 304. LPC analyzer 302 produces Linear 
Predictive (LP) coefficients of the digitized speech samples. LPC filter 304 



component 306 and Unsealed Band Energy Analyzer 314. 

Gain Computation component 306 divides each frame of digitized 

10 speech samples into sub-frames, computes a set of codebook gains, hereinafter 
referred to as gains or indices, for each sub-frame, divides the gains into sub- 
groups, and normalizes the gains of each sub-group. The speech residual 
signal r(n), n=0„. . JsJ-1, is segmented into K sub-frames, where N is the number 
of residual samples in a frame. In one embodiment, K=10 and N=160. A gain, 

15 G(i), i=0,...,K-l, is computed for each sub-frame as follows: 



Gain Quantizer 308 quantizes the K gains, and the gain codebook index 
for the gains is subsequently transmitted. Quantization can be performed using 

20 conventional linear or vector quantization schemes, or any variant. One 
embodied scheme is multi-stage vector quantization. 

The residual signal output from LPC filter 304, r(n) , is passed through a 
low-pass filter and a high-pass filter in Unsealed Band Energy Analyzer 314. 
Energy values of r(n), E w E^, and E^, are computed for the residual signal, 

25 r(n) . E x is the energy in the residual signal, r(n) . E^ is the low band energy 
in the residual signal, r(n) . E^ is the high band energy in the residual signal, 
r(n) . The frequency response of the low pass and high pass filters of Unsealed 
Band Energy Analyzer 314, in one embodiment, are shown in FIG. 7 A and FIG. 
7B, respectively. Energy values E x , ^, f and E m are computed as follows: 



produces a speech residual signal/ r(n), that is input to Gain Computation 



G(i)= £r(i*N/K + k) 2 ,i=0,„ v K-l,and 
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j=0 



1=0 



10 Energy values E v £ w , and £ w are later used to select shaping filters in 

Final Shaping Filter 316 for processing a random noise signal so that the 
random noise signal most closely resembles the original residual signal. 

Random Number Generator 310 generates unity variance, unifornjly 
distributed random numbers between -1 and 1 for each of the K sub-frames 

15 output by LPC analyzer 302. Random Numbers Selector 312 selects against a 
majority of the low amplitude random numbers in each sub-frame. A fraction 
of the highest amplitude random numbers are retained for each sub-frame. In 
one embodiment the fraction of random numbers retained is 25%, 

The random number output for each sub-frame from Random Numbers 

20 Selector 312 is then multiplied by the respective quantized gains of the sub- 
frame, output from Gain Quantizer 308, by multiplier 307. The scaled random 

signal output of multiplier 307, f\ (n) , is then processed by perceptual filtering. 

To enhance perceptual quality and maintain the naturalness of the 
quantized unvoiced speech, a two-step perceptual filtering process is 

25 performed on the scaled random signal, f\ (n) . 
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In the first step of the perceptual filtering process, scaled random signal 

ri («) is passed through two fixed filters in Perceptual Filter 318. The first fixed 
filter of Perceptual Filter 318 is a band pass filter 320 that eliminates low-end 

and high-end frequencies from to produce the signal, £2(11). The 

5 frequency response of band pass filter 320, in one embodiment is illustrated in 
FIG. 8A. The second fixed filter of Perceptual Filter 318 is Preliminary Shaping 

Filter 322. The signal, r2(/j), computed by element 320, is passed through 

PreUminary Shaping Filter 322 to produce the signal ri(n) . The frequency 
response of Preliminary Shaping Filter 322, in one embodiment, is illustrated in 
10 FIG. 8B. 

The signals r2(w), computed by element 320, and fii(n), computed by 
element 322, are computed as follows: 



i=\ j=0 



15 



The energy of signals fi(n) and h(n) are computed as E 2 and£ 3 
respectively- E 2 and£ 3 are computed as follows: 



Ei -2f a a (ii) / and 
20 E^Ztfin). 



i-0 



In the second step of the perceptual filtering process, the signal rj(/i), 
output from Preliminary Shaping Filter 322, is scaled to have the same energy 
as the original residual signal r(n) , output from LPC filter 304, based on J?, and 



25 E 3 . 
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In Scaled Band Energy Analyzer 324, the scaled and filtered random 
signal, r 3 (/j), computed by element (322), is subjected to the same band energy 
analysis previously performed on the original residual signal, r(«), by 
Unsealed Band Energy Analyzer 314. 

The signal, t »(«), computed by element 322, is computed as follows: 
^(") = ^r 3 (»),n=0,...,N-l. 



The low pass band energy of h(n)is denoted as £ w , and the high pass 

band energy of rj(n)is denoted as E^ . The high band and low band energies 

10 of ri(n) are compared with the high band and low band energies of r(n) to 
determine the next shaping filter to use in Final Shaping Filter 316. Based on 

the comparison of r(») and Fj(n), either no further filtering, or one of two 
fixed shaping filters is chosen to produce the closest match between r(«) and 

rj(w). The final filter shape (or no additional filtering) is determined by 
15 comparing the band energy in the original signal with the band energy in the 
random signal. 

The ratio, R lr of the low band energy of the original signal to the low 
band energy of the scaled pre-filtered random signal is calculated as follows: 

20 *,=10*log 10 (iVi? fr2 ). 

The ratio, R„, of the high band energy of the original signal to the high 
band energy of the scaled pre-filtered random signal is calculated as follows: 

25 ^"lO'log.o^,/^) " 
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If the ratio R § is less than -3, a high pass final shaping filter (filter 2) is 

used to further process tz(n) to produce r(«) - 

If the ratio Jt h is less than -3, a low pass final shaping filter (filter3) is 

used to further process r 3 (/?) to produce r(n) . 

5 Otherwise, no further processing of h(n) is performed, so that 

The output from Final Shaping Filter 316 is the quantized random 
residual signal f(n) . The signal r(«) is scaled to have the same energy as f 2 (n) . 
The frequency response of high pass final shaping filter (filter 2) is 
10 shown in FIG. 8C The frequency response of low pass final shaping filter (filter 
3) is shown in FIG, 8D. 

A filter selection indicator is generated to indicate which filter (filter2, 
filter 3, or no filter) was selected for final filtering. The filter selection indicator 
is subsequently transmitted so that a decoder can replicate final filtering. In 
15 one embodiment, the filter selection indicator consists of two bits. 

FIG. 4 is a detailed block diagram of the high performance low bit rate 
unvoiced speech decoder 214 illustrated in FIG 2, FIG. 4 details the apparatus 
and sequence of operations of one embodiment of the unvoiced speech 
decoder. The unvoiced speech decoder receives unvoiced data packets and 
20 synthesizes unvoiced speech from the data packets by performing the inverse 
operations of the unvoiced speech encoder 206 illustrated in FIG. 2. 

Unvoiced data packets are input to Gain De-quantizer 406. Gain De- 
quantizer 406 performs the inverse operation of gain quantizer 308 in the 
unvoiced encoder illustrated in FIG. 3. The output of Gain De-quantizer 406 is 
25 K quantized unvoiced gains. 

Random Number Generator 402 and Random Numbers Selector 404 
perform exactly the same operations as Random Number Generator 310 and 
Random Numbers Selector 310, in the unvoiced encoder of FIG, 3. 

The random number output for each sub-frame from Random Numbers 
30 Selector 404 is then multiplied by the respective quantized gain of the sub- 
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frame, output from Gain De-quantizer 406, by multiplier 405. The scaled 

random signal output of multiplier 405, is then processed by perceptual 

filtering. 

A two-step perceptual filtering process identical to the perceptual 
5 filtering process of the unvoiced encoder in FIG. 3 is performed. Perceptual 
Filter 408 performs exactly the same operations as Perceptual Filter 318 in the 
unvoiced encoder of FIG, 3. Random signal r } (n) is passed through two fixed 
filters in Perceptual Filter 408. The Band Pass Filter 407 and Preliminary 
Shaping Filter, 409 are exactly the same as the Band Pass Filter 320 and 
10 Preliminary Shaping Filter 322 used in the Perceptual Filter 318 in the unvoiced 
encoder of FIG. 3. The outputs after Band Pass Filter 407 and Preliminary 
Shaping Filter 409 are denoted as r 2 (n) and r>(n), respectively. Signals r 2 (n) 
and i\(n) are calculated as in the unvoiced encoder of FIG- 3. 

Signal r 3 («) is filtered in Final Shaping Filter 410. Final Shaping Filter 
15 410 is identical to Final Shaping Filter 316 in the unvoiced encoder of FIG. 3. 
Either high pass final shaping, low pass final shaping, or no further final 
filtering is performed by Final Shaping Filter 410, as determined by the filter 
selection indicator generated at the unvoiced encoder of FIG. 3 and received in 
the data bit packet at the decoder 214. The output quantized residual signal, 
20 r(n) , from Final Shaping Filter 410 is scaled to have the same energy as r 2 (n) . 

The quantized random signal, f(n) , is filtered by LPG synthesis filter 412 
to generate synthesized speech signal, s(n) . 

A subsequent Post-filter 414 could be applied to the synthesized speech 
signal, s(n) , to generate the final output speech. 
25 FIG. 5 is a flow chart illustrating the encoding steps of a high 

performance low bit rate coding technique for unvoiced speech. 

In step 502, an unvoiced speech encoder (not shown) is provided a data 
frame of unvoiced digitized speech samples. A new frame is provided every 20 
milliseconds. In one embodiment, where the unvoiced speech is sampled at a 
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rate of 8 kilobits per second/ a frame contains 160 samples. Control flow 
proceeds to step 504. 

In step 504, the data frame is filtered by an LPC filter, producing a 
residual signal frame. Control flow proceeds to step 506. 
5 Steps 506 - 516 describe method steps for gain computation and 

quantization of a residual signal frame. 

The residual signal frame is divided into sub-frames in step 506. In one 
embodiment each frame is divided into ten sub-frames of sixteen samples each. 
Control flow proceeds to step 508. 
10 In step 508, a gain is computed for each sub-frame. In one embodiment 

ten sub-frame gains are computed. Control flow proceeds to step 510. 

In step 510, sub-frame gains are divided into sub-groups. In one 
embodiment, 10 sub-frame gains are divided into two sub-groups of five sub- 
frame gains each. Control flow proceeds to step 512. 
15 In step 512, the gains of each subgroup are normalized, to produce a 

normalization factor for each sub-group. In one embodiment, two 
normalization factors are produced for two sub-groups of five gains each- 
Control flow proceeds to step 514. 

In step 514, the normalization factors produced in step 512 are converted 
20 to the log domain, or exponential form, and then quantized, In one 
embodiment, a quantized normalization factor is produced, herein after 
referred to as Index 1. Control flow proceeds to step 516. 

In step 516, the normalized gains of each sub-group produced in step 512 
are quantized. In one embodiment, two sub-groups are quantized to produce 
25 two quantized gain values, herein after referred to as Index 2 and Index 3. 
Control flow proceeds to step 518, 

Steps 518-520 describe the method steps for generating a random 
quantized unvoiced speech signal. 

In step 518, a random noise signal is generated for each sub-frame, A 
30 predetermined percentage of the highest amplitude random numbers 
generated are selected per sub-frame. The unselected numbers are zeroed. In 
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one embodiment, the percentage of random numbers selected is 25%. Control 
flow proceeds to step 520. 

In step 520, the selected random numbers are scaled by the quantized 
gains for each sub-frame produced in step 516. Control flow proceeds to step 
5 522. 

Steps 522 - 528 describe methods steps for perceptual filtering of the 
random signal. The Perceptual Filtering of steps 522 - 528 enhances perceptual 
quality and maintains the naturalness of the random quantized unvoiced 
speech signal. 

1° In step 522, the random quantized unvoiced speech signal is band pass 

filtered to eliminate high and low end components. Control flow proceeds to 
step 524. 

In step 524, a fixed preliminary shaping filter is applied to the random 
quantized unvoiced speech signal. Control flow proceeds to step 526. 
15 In step 526, the low and high band energies of the random signal and the 

original residual signal are analyzed. Control flow proceeds to step 528. 

In step 528, the energy analysis of the original residual signal is 
compared to the energy analysis of the random signal, to determine if further 
filtering of the random signal is necessary. Based on the analysis, either no 
20 filter, or one of two pre-determined final filters is selected to further filter the 
random signal. The two pre-determined final filters are a high pass final 
shaping filter and a low pass final shaping filter. A filter selection indication 
message is generated to indicated to a decoder which final filter (or no filter) 
was applied. In one embodiment, the filter selection indication message is 2 
25 bits. Control flow proceeds to step 530. 

In step 530, an index for the quantized normalization factor produced in 
step 514, indexes for the quantized sub-group gains produced in step 516, and 
the filter selection indication message generated in step 528 are transmitted. In 
one embodiment, Index 1, Index 2, Index 3, and a 2 bit final filter selection 
indication is transmitted. Including the bits required to transmit the quantized 
LPC parameter indices, the bit rate of one embodiment is 2 Kilobits per second. 



30 
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(Quantization of LPC parameters is not within the scope of the disclosed 
embodiments.) 

FIG. 6 is a flow chart illustrating the decoding steps of a high 
performance low bit rate coding technique for unvoiced speech. 
5 In step 602, a normalization factor index, quantized sub-group gain 

indexes, and a final filter selection indicator are received for a frame of 
unvoiced speech. In one embodiment, Index 1, Index 2, Index 3, and a 2 bit 
filter selection indication is received. Control flow proceeds to step 604. 

In step 604, the normalization factor is recovered from look-up tables 
10 using the normalization factor index. The normalization factor is converted 
from the log domain, or exponential form, to the linear domain. Control flow 
proceeds to step 606. 

In step 606, the gains are recovered from look-up tables using the gain 
indexes. The recovered gains are scaled by the recovered normalization factors 
15 to recover the quantized gains of each sub-group of the original frame. Control 
flow proceeds to step 608. 

In step 608, a random noise signal is generated for each sub-frame, 
exactly as in encoding. A predetermined percentage of the highest amplitude 
random numbers generated are selected per sub-frame. The unselected 
20 numbers are zeroed. In one embodiment, the percentage of random numbers 
selected is 25%, Control flow proceeds to step 610. 

In step 610, the selected random numbers are scaled by the quantized 
gains for each sub-frame recovered in step 606. 

Steps 612-616 describe decoding method steps for perceptual filtering of 
25 the random signal. 

In steps 612, the random quantized unvoiced speech signal is band pass 
filtered to eliminate high and low end components. The band pass filter is 
identical to the band pass filter used in encoding. Control flow proceeds to step 
614. 

30 In step 614, a fixed preliminary shaping filter is applied to the random 

quantized unvoiced speech signal. The fixed preliminary shaping filter is 
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identical to the fixed prelinunary shaping filter used in encoding. Control flow 
proceeds to step 616. 

In step 616, based on the filter selection indication message, either no 
filter, or one of two pre-determined filters is selected to further filter the 

5 random signal in a final shaping filter. The two pre-determined filters of the 
final shaping filter are a high pass final shaping filter (filter 2) and a low pass 
final shaping filter (filter 3) identical to the high pass final shaping filter and 
low pass final shaping filter of the encoder. The output quantized random 
signal from the Final Shaping Filter is scaled to have the same energy as the 

10 signal output of the band pass filter. The quantized random signal is filtered by 
an LPC synthesis filter to generate a synthesized speech signal. A subsequent 
Post-filter may be applied to the synthesized speech signal to generate the final 
decoded output speech. 

FIG, 7A is a graph of the normalized frequency versus amplitude 

15 frequency response of a low pass filter in the Band Energy Analyzers (314,324) 
used to analyze low band energy in the residual signal r(n), output from the 
LPC filter (304) in the encoder, and in the scaled and filtered random signal 

ra output from the preliminary shaping filter (322) in the encoder. 

PIG. 7B is a graph of the normalized frequency versus amplitude 
20 frequency response of a high pass filter in the Band Energy Analyzers (314,324) 
used to analyze high band energy in the residual signal r(n), output from the 
LPC filter (304) in the encoder, and in the scaled and filtered random signal, 

rs («), output from the preliminary shaping filter (322) in the encoder. 

FIG. 8A is a graph of the normalized frequency versus amplitude 
25 frequency response of a low band pass final shaping filter in Band Pass Filter 

(320,407) used to shape the scaled random signal, r\(n), output from the 
multiplier (307,405) in the encoder and the decoder. 

FIG. 8B is a graph of the normalized frequency versus amplitude 
frequency response of a high band pass shaping filter in Preliminary Shaping 
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Filter (322,409) used to shape the scaled random signal, r^n), output from the 
Band Pass Filter (320, 407) in the encoder and the decoder. 

FIG. 8C is a graph of the normalized frequency versus amplitude 
frequency response of a high pass final shaping filter, in the final shaping filter 

5 (316, 410), used to shape scaled and filtered random signal, rz(n), output from 
the preliminary shaping filter (322 7 409) in the encoder and decoder. 

FIG. 8D is a graph of the normalized frequency versus, amplitude 
frequency response of a low pass final shaping filter, in the final shaping filter 

(316, 410), used to shape scaled and filtered random signal, ri(n), output from 
10 the preliminary shaping filter (322/409) in the encoder and decoder, 

The previous description of the preferred embodiments is provided to 

enable any person skilled in the art to make or use the disclosed embodiments. 

The various modifications to these embodiments will be readily apparent to 

those skilled in the art, and the generic principles defined herein may be 
15 applied to other embodiments without the use of the inventive faculty. Thus, 

the disclosed embodiments are not intended to be limited to the embodiments 

shown herein but is to be accorded the widest scope consistent with the 

principles and novel features disclosed herein. 

20 I (WE) CLAIM: 
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